Ensemble averageability in network spectra 
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The extreme eigenvalues of connectivity matrices govern the influence of the network structure on 
a number of network dynamical processes. A fundamental open question is whether the eigenvalues 
of large networks are well represented by ensemble averages. Here we investigate this question 
explicitly and validate the concept of ensemble averageability in random scale-free networks by 
showing that the ensemble distributions of extreme eigenvalues converge to peaked distributions 
as the system size increases. We discuss the significance of this result using synchronization and 
epidemic spreading as example processes. 

PACS numbers: 05.50.+q, 05.10.-a, 87.18.Sn, 89.75.-k 
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The structure and dynamics of complex networks is 
of increasing interest in nonlinear dynamics, biological 
physics, complex systems, and statistical physics [3, [1, 01 ■ 
Part of this interest comes from the realization that com- 
monly observed structural properties, such as the scale- 
free (SF) degree distribution [4|, strongly influence the 
collective dynamics of the system. In many dynamical 
processes, the influence of the network structure is en- 
coded in the extreme eigenvalues of a connectivity ma- 
trix. In complete synchronization and consensus phe- 
nomena, for example, the stability and convergence are 
often determined by the largest and smallest nonzero 
eigenvalues of the Laplacian matrix @, 01- I n diffu- 
sion processes, the relaxation rate is governed by the cor- 
responding eigenvalues of the normalized Laplacian Q. 
The largest eigenvalue of the adjacency matrix, on the 
other hand, plays a central role in determining epidemic 
thresholds [9|, LLQ( and critical couplings for the onset of 



coherent behavior 11|. 



Our ultimate goal is to find a way to determine the 
extreme eigenvalues (and thereby the dynamics) of net- 
works by only using averages and local information about 
the network structure. This problem is properly defined 
for ensembles of networks and involves two elements: de- 
termination of the ensemble averages and characteriza- 
tion of the fluctuations across the ensemble. Previous 
studies on ensemble averages have focused on spectral 



studies on ensemble averages nave locusea on spectral 
densities 0, 0, 0, EH and applications @, II S, S S, H , 
while here we focus on the extreme eigenvalues. In this 
case, the study of fluctuations is crucial to assess how 
well the averages reflect the properties of individual net- 
works in the ensemble. The broader the distributions of 
extreme eigenvalues across the ensemble, the more lim- 
ited the information provided by the averages will be. 
It has been suggested recently that the degree distribu- 
tion and other statistical properties are not sufficient to 
characterize the eigenvalues of random SF networks . 
Though the spectral properties of these networks are dif- 
ferent from those traditionally considered in random ma- 
trix theory [13], as far as we know, extreme eigenvalue 
distributions have not been studied for network ensem- 



bles and their statistical properties remain essentially un- 
known. 

In this Letter, we investigate the averageability of the 
extreme eigenvalues in ensembles of random SF networks. 
We define a quantity to be ensemble averageable if the 
variance of its probability distribution goes to zero in 
the limit of large system size. We show that the largest 
eigenvalues of the Laplacian and adjacency matrices are 
determined mainly by the largest degree node of the net- 
work, while the smallest nonzero eigenvalue of the Lapla- 
cian depends on the details of the way in which nodes are 
connected. We provide strong evidence that the smallest 
nonzero eigenvalue of the Laplacian and both extreme 
eigenvalues of the normalized Laplacian are ensemble av- 
erageable. That is, as the number of nodes increases, 
the distributions become increasingly more peaked and 
the averages provide increasingly more accurate informa- 
tion about the behavior of most networks in the ensem- 
ble. We apply these findings to the study of synchroniza- 
tion and epidemic spreading. We show that the physical 
quantities characterizing the dynamics are averageable 
and properly represented by functions of the averages of 
the extreme eigenvalues. This provides an unambiguous 
spectral characterization of the dynamics in ensembles of 
large-size networks. 

We focus on undirected random SF networks with 
the constraints of having a single connected component 
and no self- or multiple links. Starting with a graphic 
degree sequence for N nodes generated from a power- 
law distribution Pd{k) — Cdk ' with k > fco, where 
Cd — (7 — l)^o 1 f° r l ar S e N, we construct an ini- 
tial network satisfying the given constraints (l8j . Then, 
we randomize the network topology using the degree- 
preserving algorithm of Ref. [l9( to implement (J2i^i) 2 
link-rewirings, while keeping the constraints by reject- 
ing constraint-breaking rewirings. The only degree cor- 
relations in the network construction are those due to 
these constraints (see, for example, Ref. We fo- 

cus on the ensemble of all such networks. We consider 
three connectivity matrices of broad interest: the ad- 
jacency matrix A, defined as Aij = 1 if nodes i and 



2 



(a) 



2000 



°- 1000 



- 


Y=3.0 




— N=2" 




... N=2 '° 




- N=2 9 







(b) 



10 



~o 10' 



10 



♦ 1=5.0 
O -p4.0 
■ 1^3.4 
□ Y=3.0 

• -F2.6 
O Y=2.4 



1.005 



1.01 



FIG. 

Ajv = 



Numerical results for (a) the distribution P(Ajv) of 
j- and (b) the A^-dependence of the corresponding 
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standard deviation a. All the numerics are obtained from 
5000 — 10 realizations of the networks with ko = 3. 



j i are connected and A+j = otherwise; the Laplacian 
L = D — A and the normalized Laplacian L = D _1 L, 
where D = diagjfci, . . . , fcjv} is the diagonal matrix of 
degrees. For undirected networks, all the eigenvalues 
of these matrices are real. The eigenvalues of L and 
L can be ordered as Ai — < A2 < ••■ < \n and 
/ii = < \i2 < ••■ < <2, respectively. The largest 
eigenvalue of A is positive and is denoted by Ajy. The 
nodes are labeled in increasing order of their degrees ki , 
such that ki < k% ■ ■ • < fc/v- 

For the Laplacian L, we estimate the largest eigenvalue 
Xn by using nondegenerate perturbation theory [2l|. In 
L = D — A, we consider D as an unperturbed matrix and 
—A as a perturbation. This decomposition leads to the 
perturbation expansion of Ajv , which up to second order 
of A is: 



A 



N 



k N - A 



NN ' 



k N + 1. 



(1) 



Here we have used the fact that the second order term can 



be expanded as J2j(ANj) 2 (j-- 



= 1- 



where k 



(1) 



k\r /k N 



< 1 for 7 > 2 and large N (H, which 
few + 1 for large N. This result is quite 



N is the average degree of the nearest neigh- 
bors of node N. In uncorrelated SF networks, fcjy 

K N £, k kP d (k) 

leads to Aat : 

neat since Xn of any network is lower bounded by /cat + 1 
[2^ |. The same approach can also be used to predict a 
power-law tail for the A-density, p(X) ~ A~ 7 be- 
cause Xi ~ ki is still valid for other nondegenerate ki 's in 
the tail of Pd ~ fc~ 7 . Similarly, we can also obtain the 
largest eigenvalue Aat of the adjacency matrix by consid- 
ering the largest diagonal term of matrix A 2 , given by 
kN, and regarding the off-diagonal elements as a pertur- 
bation. Under the approximation of local tree-like struc- 
ture, we obtain K 2 N ~ fc^r + k^ — 1, which provides a 
second-order correction to the previous result A 2 ^ ~ fc/v 

HBO. 

Equation fTj implies that Aat depends on the spe- 
cific realization of the degree sequence, which fluctuates 
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FIG. 2: Ensemble distributions of (a) A2 and (b) fi2- The 
statistics of /j,n is not shown because it is well approximated 
by that of 2 — ^2- The unspecified parameters are defined in 

Fig.m 



widely across the ensemble. For N integers randomly 
generated from Pd(k), the asymptotic form of the proba- 
bility distribution of the largest one, kN, is given by the 
Frechet distribution P(k N ) ^ CdNk' 1 exp[-N d^) 7 " 1 ] 
[25l | . The average of k N can be obtained from P(fcjy) 

as (k N ) ~ koN^ expt^j^jrt 7 ^!, jfc=s], where T[a,b] 
denotes the Incomplete Gamma Function. The standard 
deviation of P(fcAr) increases as ~ N1- 1 in the same way 
as (k^ does. This implies that kN, and hence Xn, are 
not averageable quantities in this ensemble. 

Instead, the corresponding ensemble averageable quan- 
tity is the reduced largest eigenvalue Aat = Aat/X^n + !)■ 
While Aat may deviate from the prediction in Eq. (jTJ) , 
the numerical calculation confirms that, as N grows, the 
distribution of Aat becomes extremely peaked, as shown 
in Fig.[T] This indicates that A a? of large random SF net- 
works is accurately determined exclusively by kN, which 
involves local information only. 

On the other hand, we find that A2, /12 and [In 
are ensemble averageable by themselves. As shown in 
Fig. [2J these eigenvalues have bell-shaped distributions 
with well-defined averages in the ensemble of SF net- 
works. We note that the statistics of pn is indistinguish- 
able from that of 2 — fj,2- More important, we find that 
P(A2) and P{^2) converge to increasingly peaked distri- 
butions as N increases. We have confirmed this behavior 
by analyzing the iV-dependence of the standard devia- 
tion, which decreases with increasing N. This indicates 
that the probability of having large deviations from the 
averages decreases to very small values as the size of the 
system increases. Therefore, for large N , the eigenvalues 
A2, fi2 and p n of most networks in the ensemble are well 
represented by the ensemble averages. 

To provide approximate bounds for the ensemble av- 
erages, we derive an approximation for the extremes of 
the spectral density of uncorrelated tree-like networks in 
the thermodynamic limit. For the Laplacian L, the spec- 
tral density is given by p(A) = -^Im^Tr (A+ . t0 1 +)I _ L ) 
and can be analyzed using a weighted version of the ran- 
dom walk method with a multiplying weight 
factor of [kj - (A + i0+)] _1 . This leads to p(X) ~ 
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FIG. 3: Numerical results for the ensemble averages (a) {A2) 
and (b) (/X2) (dotted lines). We also show A - and p~ pre- 
dicted by Eqs. ([2]) and ([3]), respectively, for the same degree 
distribution (r.h.s. symbols) and for fc-regular graphs with de- 
gree fco (horizontal solid lines). The symbols and parameters 
are the same as in Fig. [1] 



7 Im Efc fc-A-ffl++fcT(A) ' Where T ( A ) SatisfieS T ( X ) = 

^y£ fc fc -A-«o fe + P -( ( fc-i)r(A) . with < fc > = £**f«i(*)- To 
obtain the lower extreme A we note that T is complex 
(so that p(X) > 0) if A > A - , and T is real (so that 
p(A) = 0) if A < A - . Then, for real x = such that 

9{x) = Efc < !> we obtain 



A ~ max — 

x 2 



< + l+|z-l|Vl -<?(*) 



(2) 



For the normalized Laplacian L, it is known [l3j that 
the spectral density is given by p[y) ~ —^lm v _^,^ with 

T{y) satisfying T(u) = -fa E fc kv+m+-\k-imv) > where 
v = 1 — fi. From the identity T*(v) = —T(—v) we obtain 
the spectral symmetry p(y) ~ p{— v), which helps explain 
our numerical result (hn) — 2— (^2) (cf. Fig. [2]). We then 
obtain an approximate expression for the upper (lower) 
extreme p + (fJ-~) by using the same argument used to 
derive Eq. ([2]). For real x = T/u, 
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kP d (k) 



(k)x ^— ' k — (k — l)x 



(3) 



If fc is large, the r.h.s. of Eq. approaches ^ k ^{k — 
l)P d (k)/(k(k)) and p ± ^ l±2/yW> which agrees with 
previous results for densely connected networks (l4, 24 [. 

For the large but finite-size sparse networks of our in- 
terest, the actual ensemble average (/X2) is expected to 
fall inside of the pseudogap region (0, p~) because of the 
existence of extended tails of p(p) (see Ref. [27[ for the 
case of homogeneous networks). Then, given a degree 
distribution, pT serves as an approximate upper bound 
for (p2)- On the other hand, because all the networks 
in the ensemble have all degrees > fco, the average {P2) 
is expected to be lower bounded by the corresponding 
average of the ensemble of fc-regular random graphs with 
degree fc = fco for all the nodes, which is nonzero for 
fco > 3 [iij l. Thus, we can write pT^ < (/X2) % \i~ and, 
symmetrically, we have p + < (/ijv) ;$ Mil where p^ de- 
notes p^ at 7 = 00, representing fc-regular graphs with 
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FIG. 4: (a) (f(x)) vs. f({x)) for synchronization [(i? M ) vs. 
-^y (squares), (R\) vs. (circles)] and epidemics 

vs. 1 (diamonds)] for networks with iV = 2 8 — 2 12 and 
7 = 2.4 — 5.0. Panels (b)-(d) show the ensemble distributions 
for 7 = 3.0 and N = 2 9 - 2 11 . Here, 7? A = R x /{k N + 1). The 
other parameters are the same as in Fig. ff] 



P(k) = 5(k — fco). For A2, similar arguments lead to 
^00 (^2) A - , where A^ is A - at 7 = 00. As shown 
in Fig. [31 the numerical results are in good agreement 
with these predictions. 

We now use synchronization and epidemic spreading as 
example processes to show how our findings can impact 
the study of network dynamics. In the complete syn- 
chronization of identical oscillators, the ability of an os- 
cillator network to synchronize is measured by the range 
of the coupling parameter for which synchronization is 
stable and is determined by R\ = Xn/M M- ^ the 
input signal is normalized to be equal for all the oscilla- 
tors, then the same stability condition is determined by 
= //jv/M2 0' In epidemic spreading, on the other 
hand, the epidemic threshold of the susceptible-infected- 
susceptible model is determined by 1/Ajv [§]. These dy- 
namical processes, as well as many others, are determined 
by functions of the extreme eigenvalues. To characterize 
a process in SF networks, in principle one would have 
to average the corresponding function over all possible 
realizations of the networks or study the process on a 
case-by-case basis. We have shown, however, that the ex- 
treme eigenvalues are well represented by averages com- 
bined with local information. A practical question then 
is whether one can approximate the averages of the func- 
tions by functions of the average eigenvalues. 

The average of a function, (/(x)), is not necessar- 
ily equal to the function of the average, f((x}). How- 
ever, from the identity Ylif( x i)/ n = f(J2i x i/ n ) f° r 
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X\ = x% = ■ ■ ■ = x n , one expects that, if the distribution 
of x goes to a <5-like function in the thermodynamic limit, 
then (f(x)) approaches f({x)). For finite N, this can be 
formalized for locally monotonic functions by noting that 
the probability distributions of the function and vari- 
able are related through P f (f(x)) = P x (x)/&jj£. If f(x) 
can be expressed as a uniformly convergent Taylor series 
around x = (x), the deviation of f((x)) from (f(x)) can 
be written as (f(x)) - f((x)) = £~ 2 ^/ (n) «z»((z - 
(x)) n ), where f^({x}) denotes the nth derivative of f{x) 
at x = (x). In this case, the central moments ((x— (x)) n ) 
determine the iV-dependence of the deviation. If x is av- 
erageable, this deviation is expected to decrease as N 
increases and the central moments decrease. 

In Fig. [U we show numerically that the averages of 
the functions R\ = R\/(kN + 1), R^, and 1/Ajv are 
indeed well approximated by the functions of the average 
eigenvalues: 
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In the lower panels of Fig. IU we show that the prob- 
ability distributions of these functions become increas- 
ingly more peaked as N increases, which indicates that 
the functions themselves are ensemble averageable. Note 
that we have normalized R\ to benefit from the fact 
that Ajv is averageable. The function R\ is broadly dis- 
tributed in the ensemble but can be estimated for in- 
dividual realizations of the network using R\ ~ (fejv + 
1)(R\). A similar argument could be used for 1/Ajy, 

although in this case the extreme statistics [2|| of x — 

_ i 

k N 2 ~ 1/Ajv is directly given by the Weibull distribution 
P(x) cx x 27-3 exp(— cNx 2l ~ 2 ), which becomes increas- 
ingly peaked as N increases. 

The importance of our results is twofold. First, despite 
the rich variety of possible structural configurations of in- 
dividual networks, one can conclude that most networks 
in an ensemble of large SF networks have remarkably sim- 
ilar spectral properties. Second, many network dynami- 
cal processes can be described using average eigenvalues 
and local information provided by the degrees, which re- 
quire very few network parameters. These results have 
broad significance in view of the previous finding (lij 
that there are networks in the SF ensemble with very 
different extreme eigenvalues, implying large deviations 
in the corresponding dynamics. Our results show that 
the probabilities of such large deviations are remarkably 
small and decrease with the increasing size of the net- 
works. 

The averageability of the extreme eigenvalues estab- 
lished in this Letter helps provide an unambiguous set- 
ting for the spectral characterization of dynamical pro- 
cesses on ensembles of complex networks. For large ran- 
dom SF networks, our results show that the eigenvalues 
A2 , fJ-2, and ijln are statistically well characterized by the 



ensemble averages determined by the degree distribution, 
which is in sharp contrast with the conclusions drawn 
from the study of particular networks [lfj. Our conclu- 
sion also applies to and A^v normalized by simple 
functions of the maximum degree. These results provide 
evidence of self-averaging properties reminiscent of the 
laws of large numbers and are likely to remain valid for 
other ensembles of disordered networks. 

The authors thank David Taylor, Hermann Riecke, 
and Byungnam Kahng for providing feedback on the 
manuscript. 
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